Information processing apparatus, method thereof, and program thereof, and information processing system

ABSTRACT

An information processing apparatus, a method thereof, and a program thereof, and an information processing system that can perform imaging complying with content of an instruction are provided. 
     An information processing apparatus acquires input of first information related to information about equipment used for imaging from a first terminal apparatus of an imaging person, acquires input of second information related to information about content of an instruction with respect to imaging from a second terminal apparatus of a requesting person, derives a setting of the equipment required for performing imaging complying with the instruction and an operation method of the equipment required for the setting based on the first information and on the second information, and outputs third information related to information about the operation method to the first terminal apparatus of the imaging person.

CROSS-REFERENCE TO RELATED APPLICATION

The present application claims priority under 35 U.S.C § 119(a) toJapanese Patent Application No. 2022-121543 filed on Jul. 29, 2022,which is hereby expressly incorporated by reference, in its entirety,into the present application.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to an information processing apparatus, amethod thereof, and a program thereof, and an information processingsystem, and particularly to an information processing apparatus, amethod thereof, and a program thereof, and an information processingsystem for processing information related to operation of equipment usedfor imaging.

2. Description of the Related Art

JP2014-10825A discloses a technology for finding a person to cooperatein imaging using social media with respect to a request for imaging.

JP2006-14119A discloses a system that transmits an image captured by avideo camera to a client through a network.

JP2008-258744A discloses a technology for converting an imagingoperation performed using one camera out of two cameras having differentoperation methods into the operation method of the other camera anddisplaying the converted imaging operation on a display unit of theother camera.

JP2007-201693A discloses a technology for performing a desired imagingcontrol setting by performing a layered guidance display.

SUMMARY OF THE INVENTION

One embodiment according to the disclosed technology provides aninformation processing apparatus, a method thereof, and a programthereof, and an information processing system that can perform imagingcomplying with content of an instruction.

-   -   (1) An information processing apparatus comprising a processor,        in which the processor is configured to acquire input of first        information related to information about equipment used for        imaging, acquire input of second information related to        information about content of an instruction with respect to        imaging, derive a setting of the equipment required for        performing imaging complying with the instruction and an        operation method of the equipment required for the setting based        on the first information and on the second information, and        output third information related to information about the        operation method.    -   (2) The information processing apparatus according to (1), in        which the processor is configured to output the second        information.    -   (3) The information processing apparatus according to (1) or        (2), in which the second information is composed of text        information, and the processor is configured to extract a topic        related to imaging from the text information, and derive the        setting corresponding to the topic.    -   (4) The information processing apparatus according to (3), in        which the processor is configured to derive the setting        corresponding to the topic by referring to a first database in        which information related to the setting is recorded.    -   (5) The information processing apparatus according to (4), in        which the processor is configured to derive the setting        corresponding to the topic by referring to the first database in        which the topic and the information related to the setting are        recorded in association with each other.    -   (6) The information processing apparatus according to any one        of (1) to (5), in which the processor is configured to acquire        information related to a manual corresponding to the equipment        from a second database in which information related to a manual        of the equipment is recorded, and derive the operation method        based on the information related to the manual.    -   (7) The information processing apparatus according to (6), in        which the first information includes the information related to        the manual of the equipment, and the processor is configured to        acquire the input of the first information and record the        information related to the manual of the equipment included in        the first information in the second database.    -   (8) The information processing apparatus according to (6) or        (7), in which the processor is configured to extract, from the        manual of the equipment, a location in which the operation        method of the equipment required for the setting is described.    -   (9) The information processing apparatus according to any one        of (1) to (8), in which the processor is configured to acquire        the input of the first information from a first terminal,        acquire the input of the second information from a second        terminal, and output the third information and the second        information to the first terminal.    -   (10) The information processing apparatus according to (9), in        which the processor is configured to receive images captured by        the equipment in time series and transmit the images to the        second terminal.    -   (11) The information processing apparatus according to any one        of (1) to (10), in which the processor is configured to receive        information related to a setting of the equipment in capturing        an image, and derive the setting of the equipment required for        performing imaging complying with the instruction and the        operation method of the equipment required for the setting based        on the first information, the second information, and the        information related to the setting of the equipment in capturing        the image.    -   (12) An information processing system comprising a first        terminal owned by a first user contracted to perform imaging, a        second terminal owned by a second user who requests imaging, and        the information processing apparatus according to any one of (1)        to (11), in which the information processing apparatus acquires        the input of the first information from the first terminal,        acquires the input of the second information from the second        terminal, and outputs the third information to the first        terminal.    -   (13) An information processing method comprising acquiring input        of first information related to information about equipment used        for imaging, acquiring input of second information related to        information about content of an instruction with respect to        imaging, deriving a setting of the equipment required for        performing imaging complying with the instruction and an        operation method of the equipment required for the setting based        on the first information and on the second information, and        outputting third information related to information about the        operation method.    -   (14) An information processing program causing a computer to        implement a function of acquiring input of first information        related to information about equipment used for imaging, a        function of acquiring input of second information related to        information about content of an instruction with respect to        imaging, a function of deriving a setting of the equipment        required for performing imaging complying with the instruction        and an operation method of the equipment required for the        setting based on the first information and on the second        information, and a function of outputting third information        related to information about the operation method.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram illustrating an example of a configuration of aninformation processing system.

FIG. 2 is a block diagram illustrating an example of a hardwareconfiguration of a first terminal apparatus.

FIG. 3 is a block diagram showing an example of a hardware configurationof a second terminal apparatus.

FIG. 4 is a block diagram illustrating an example of a hardwareconfiguration of a data storage server.

FIG. 5 is a block diagram of main functions provided by an informationprocessing apparatus.

FIG. 6 is a block diagram of main functions of an instructioninformation analysis unit.

FIG. 7 is a diagram illustrating an example of an equipment settingdatabase.

FIG. 8 is a diagram illustrating an example of a manual database.

FIG. 9 is a diagram illustrating an example of display of operationinformation, instruction information, and setting information on adisplay.

FIG. 10 is a sequence diagram of processing performed by the informationprocessing system.

FIG. 11 is a diagram illustrating a second embodiment of the informationprocessing system.

FIG. 12 is a block diagram of main functions provided by the informationprocessing apparatus.

FIG. 13 is a diagram illustrating an example of display on a display ofthe second terminal apparatus.

FIG. 14 is a block diagram of main functions provided by the informationprocessing apparatus.

FIG. 15 is a main block diagram of functions of the instructioninformation analysis unit.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, preferred embodiments of the present invention will bedescribed in detail in accordance with the accompanying drawings.

First Embodiment

A matching service as a service for arranging a match and connectingbetween a person having demand and a person capable of providing supplyhas been known. In the field of photography, a matching service forarranging a match and connecting between a person who wants to requestimaging and a person capable of performing imaging has been known. Byusing the matching service, for example, it is possible to requestimaging by simply finding a person who can deal with the request even ina case where imaging is performed at a remote location.

However, the matching service in photography poses a problem in that itis difficult to designate equipment. Thus, problems arise in that it isdifficult to understand to which operation an imaging instruction of arequesting person corresponds in equipment of an imaging person, andthat it is difficult to provide a detailed imaging instruction.

In the present embodiment, an information processing system capable ofperforming imaging that reflects intention of the requesting person in acase of requesting another person to perform imaging using the matchingservice or the like will be described.

Information Processing System

The information processing system of the present embodiment isconfigured as a system that receives an instruction with respect toimaging from the requesting person, derives an operation method ofequipment required for performing imaging complying with theinstruction, and presents the operation method to the imaging person.

System Configuration

FIG. 1 is a diagram illustrating an example of a configuration of theinformation processing system.

As illustrated in FIG. 1 , an information processing system 1 has aconfiguration comprising a first terminal apparatus T1 owned by animaging person P1, a second terminal apparatus T2 owned by a requestingperson P2, and an information processing apparatus 10 that processesinformation acquired from the first terminal apparatus T1 and from thesecond terminal apparatus T2. The information processing apparatus 10 iscommunicably connected to the first terminal apparatus T1 and to thesecond terminal apparatus T2 through a communication network 2. Thecommunication network 2 is constructed of, for example, a wirelesscommunication network such as 5th generation (5G), 4th generation (4G),3rd generation (3G), Worldwide Interoperability for Microwave Access(WiMAX), or long term evolution (LTE), each base station 2 a, and theInternet.

In the information processing system 1 of the present embodiment, theimaging person P1 corresponds to a first user contracted to performimaging, and the requesting person P2 corresponds to a second user whorequests imaging. The first terminal apparatus T1 is an example of afirst terminal, and the second terminal apparatus T2 is an example of asecond terminal.

First Terminal Apparatus and Second Terminal Apparatus

The first terminal apparatus T1 and the second terminal apparatus T2 arecomposed of computers having a communication function. Specifically, thefirst terminal apparatus T1 and the second terminal apparatus T2 arecomposed of mobile computers such as a smartphone, a tablet terminal, alaptop personal computer, or personal data assistance (PDA) having acommunication function.

FIG. 2 is a block diagram illustrating an example of a hardwareconfiguration of the first terminal apparatus. FIG. 2 illustrates anexample of a case where the first terminal apparatus T1 is composed of asmartphone.

As illustrated in FIG. 2 , the first terminal apparatus T1 comprises aCPU 101, a ROM 102, a RAM 103, a flash memory 104 that stores variousprograms including an operating system (OS) and various types of data, adisplay 105, a touch panel 106 that detects a touch operation on adisplay screen, a GPS reception unit 107 that receives a globalpositioning systems (GPS) signal, a camera unit 108 that electronicallycaptures an image, a microphone unit 109 that inputs voice, a speakerunit 110 that outputs voice, a communication unit 111 that wirelesslycommunicates with the nearest base station 2 a or the like through anantenna 111A, a short range wireless communication unit 112 thatwirelessly communicates with an external apparatus in a short rangethrough an antenna 112A, a sensor unit 113 including various sensorssuch as a geomagnetic sensor, a gyro compass, and an accelerationsensor, a media drive 114 that reads and writes data on a memory card115, and the like.

The first terminal apparatus T1 receives input of predeterminedinformation from the imaging person P1 and transmits the inputinformation to the information processing apparatus 10. In addition,information transmitted from the information processing apparatus 10 isreceived and output to the display 105. In addition, voice is outputfrom the speaker unit 110 as necessary. The first terminal apparatus T1implements these functions by executing a predetermined program via theCPU 101 that is a processor.

FIG. 3 is a block diagram showing an example of a hardware configurationof the second terminal apparatus. FIG. 3 illustrates an example of acase where the second terminal apparatus T2 is composed of a smartphone.

As illustrated in FIG. 3 , the second terminal apparatus T2 comprises,in the same manner as the first terminal apparatus T1, a CPU 201, a ROM202, a RAM 203, a flash memory 204, a display 205, a touch panel 206, aGPS reception unit 207, a camera unit 208, a microphone unit 209, aspeaker unit 210, a communication unit 211 that wirelessly communicateswith the nearest base station 2 a or the like through an antenna 211A, ashort range wireless communication unit 212 that wirelessly communicateswith an external apparatus in a short range through an antenna 212A, asensor unit 213, a media drive 214 that reads and writes data on amemory card 215, and the like.

The second terminal apparatus T2 receives input of predeterminedinformation from the requesting person P2 of imaging and transmits theinput information to the information processing apparatus 10. Inaddition, information transmitted from the information processingapparatus 10 is received and output to the display 205. In addition,voice is output from the speaker unit 210 as necessary. The secondterminal apparatus T2 implements these functions by executing apredetermined program via the CPU 201 that is a processor.

Information Processing Apparatus

The information processing apparatus 10 is composed of a computer havinga communication function.

FIG. 4 is a block diagram illustrating an example of a hardwareconfiguration of a data storage server.

As illustrated in FIG. 4 , the information processing apparatus 10comprises a CPU 11, a ROM 12, a RAM 13, an auxiliary storage device 14that stores various programs including an OS and various types of data,a display 15, a network interface (I/F) 16 for data communication usingthe communication network 2, a keyboard 17, a mouse 18, an optical drive19, and the like. For example, the auxiliary storage device 14 iscomposed of a flash memory including a solid state drive (SSD) or of ahard disk drive (HDD). The CPU 11 is an example of a processor.

FIG. 5 is a block diagram of main functions provided by the informationprocessing apparatus.

As illustrated in FIG. 5 , the information processing apparatus 10 hasfunctions of an equipment information acquisition unit 10A, aninstruction information acquisition unit 10B, an instruction informationanalysis unit 10C, an operation method derivation unit 10D, an operationinformation output unit 10E, and the like. Functions of each unit areimplemented by executing a predetermined program (information processingprogram) via the CPU 11.

The equipment information acquisition unit 10A acquires input ofinformation about equipment C (equipment information) used for imaging.The input of the equipment information is acquired from the firstterminal apparatus T1. The imaging person P1 contracted to performimaging inputs the equipment information into the first terminalapparatus T1 owned by the imaging person Pb. In a case where theequipment information is input, the first terminal apparatus T1transmits the input equipment information to the information processingapparatus 10. The equipment information acquisition unit 10A receivesand acquires the equipment information transmitted from the firstterminal apparatus T1.

Here, the equipment information is composed of information with whichthe equipment C used for imaging can be specified. The equipment C usedfor imaging is a so-called camera. Cameras include an apparatus having acamera function. Accordingly, the equipment C used for imaging includesa smartphone with a camera, a tablet terminal with a camera, and thelike. The equipment information is composed of, for example, acombination of a manufacturer name and an apparatus type name. Themanufacturer name is a company name of a manufacturer. The apparatustype name has the same meaning as a product name, a model name, a serialnumber, a model number, and the like. For example, in a case of using acamera of an apparatus type “X-001” of “ABC Company”, the equipmentinformation is “ABC, X-001”. Here, “ABC” is the manufacturer name, and“X-001” is the apparatus type name.

For the input of the equipment information, for example, a configurationof directly inputting texts of the manufacturer name and the apparatustype name may be used, or a configuration of selecting and inputting theequipment information from candidates may be used. In the configurationof selecting and inputting the equipment information from candidates,first, a list of selectable manufacturer names is displayed on thedisplay 105, and the imaging person P1 selects one from the displayedlist of manufacturer names. Then, for example, a list of apparatus typenames of apparatus types being sold from the selected manufacturer isdisplayed on the display 105, and the imaging person P1 selects one fromthe displayed list of apparatus type names. For the text input, ageneral text input function provided in the first terminal apparatus T1is used.

In the present embodiment, the “equipment information” is an example offirst information related to the information about the equipment C usedfor imaging.

The instruction information acquisition unit 10B acquires input ofinformation about content of the instruction (instruction information)with respect to imaging. The input of the instruction information isacquired from the second terminal apparatus T2. The requesting person P2of imaging inputs the instruction information into the second terminalapparatus T2 owned by the requesting person P2. In a case where theinstruction information is input, the second terminal apparatus T2transmits the input instruction information to the informationprocessing apparatus 10. The instruction information acquisition unit10B receives and acquires the instruction information transmitted fromthe second terminal apparatus T2.

For the input of the instruction information, for example, aconfiguration of inputting a text of instruction content may be used, ora configuration of inputting voice using a well-known voice recognitiontechnology may be used. For the text input, a general text inputfunction provided in the second terminal apparatus T2 is used.

In the present embodiment, the instruction content is expressed in anatural language as an example. Accordingly, the instruction informationis composed of a sentence expressed in a natural language and iscomposed of information about a text (text information) in which thesentence is expressed with a text. Accordingly, for example, an imaginginstruction is input in an expression format such as “please performimaging to have a soft look” or “please perform imaging to have adynamic look”.

In the present embodiment, the “instruction information” is an exampleof second information related to the information about the content ofthe instruction with respect to imaging.

The instruction information analysis unit 10C analyzes the instructioninformation acquired by the instruction information acquisition unit 10Band derives a setting of the equipment required for performing imagingcomplying with the instruction.

FIG. 6 is a block diagram of main functions of the instructioninformation analysis unit.

As illustrated in FIG. 6 , the instruction information analysis unit 10Chas functions of a topic extraction unit 10C1, an equipment settingderivation unit 10C2, and the like.

The topic extraction unit 10C1 analyzes the instruction information andextracts a topic from the sentence showing the content of theinstruction. A topic related to imaging is extracted as the topic. Forexample, the topic extraction unit 10C1 is composed of a topic modelgenerated using machine learning (for example, composed of a well-knowntopic model such as latent dirichlet allocation (LDA)). In addition, forexample, the topic extraction unit 10C1 performs processing(morphological analysis) of dividing the sentence into words asnecessary.

By the topic extraction unit 10C1, for example, a topic “to have a softlook” is extracted from the imaging instruction “please perform imagingto have a soft look”. In addition, a topic “to have a dynamic look” isextracted from the imaging instruction “please perform imaging to have adynamic look”.

The equipment setting derivation unit 10C2 derives a setting of theequipment (camera) corresponding to the topic extracted by the topicextraction unit 10C1. Here, the topic extracted by the topic extractionunit 10C1 is a topic extracted from the instruction information.Accordingly, the setting of the equipment complying with the instructionis derived by deriving the setting of the equipment corresponding to thetopic. That is, the setting of the equipment required for performingimaging complying with the instruction is derived. Here, the setting ofthe equipment is a universal setting that applies to any imagingequipment (camera). For example, the setting is about a shutter speed(imaging time), an F number (F-number), International Organization forStandardization (ISO) sensitivity (ISO film speed), an exposurecorrection amount, white balance, and a lens.

In the present embodiment, the equipment setting derivation unit 10C2derives the setting of the equipment corresponding to the topic byreferring to an equipment setting database (DB) 14A.

FIG. 7 is a diagram illustrating an example of the equipment settingdatabase.

In the equipment setting database 14A, a plurality of terms related toimaging are recorded, and information related to the setting of theequipment (setting information) is recorded in association with eachrecorded term. The recorded terms are terms that may be extracted as thetopic. In other words, the terms recorded in the equipment settingdatabase 14A are extracted by the topic extraction unit 10C1. The termsrecorded in the equipment setting database 14A are composed of thevocabulary in the field of imaging. The setting information of theequipment is composed of information related to the setting of theequipment required for imaging with respect to the associated terms. Forexample, as illustrated in FIG. 7 , information “F number: low, exposurecorrection: positive” is recorded as the setting information of theequipment with respect to the term “to have a soft look”. In a case ofimaging to have a soft look, generally, blurriness is used, and imagingis performed with brightness. Thus, the setting information of contentindicating setting the F number to be low and correcting exposure to apositive side is recorded with respect to the term “to have a softlook”. In addition, information “F number: high, lens: wide angle” isrecorded as the setting information of the equipment with respect to theterm “to have a dynamic look”. In a case of imaging a landscape or thelike to have a dynamic look, generally, a lens having a wide angle ofview is used. In addition, imaging is performed to have a sharp look byhighlighting contrast. Thus, the setting information of contentindicating using a wide angle lens or zooming to a wide side and settingthe F number to be high is recorded with respect to the term “to have adynamic look”.

The equipment setting derivation unit 10C2 acquires the settinginformation of the equipment corresponding to the topic by referring tothe equipment setting database 14A with respect to the topic extractedby the topic extraction unit 10C1.

The equipment setting database 14A is stored in the auxiliary storagedevice 14. In the present embodiment, the equipment setting database 14Ais an example of a first database in which the information related tothe setting is recorded.

The operation method derivation unit 10D derives an operation method ofthe equipment C required for performing the setting derived by theinstruction information analysis unit 10C. In the present embodiment,the operation method derivation unit 10D derives the operation method ofthe equipment C by referring to a manual database 14B.

FIG. 8 is a diagram illustrating an example of the manual database.

Data of a manual of each equipment (manual data) is recorded in themanual database 14B. For example, the manual data is recorded inassociation with the manufacturer name and with the apparatus type name.Thus, corresponding manual data can be specified from information aboutthe manufacturer name and the apparatus type name acquired as theequipment information. The operation method derivation unit 10D acquiresthe manual data of the equipment C used by the imaging person P1 fromthe manual database 14B based on the equipment information acquired bythe equipment information acquisition unit 10A.

The manual data is configured to include body data in which theoperation method is described, and index data. The body data is recordedin a predetermined electronic document file format. As an example, thebody data is recorded in portable document format (PDF). The index datais data for an index and is data in which main phrases, items, and thelike described in the body data are lined up in a specific arrangementand in which locations thereof (pages on which descriptions thereof arepresent) are recorded. Usually, indexes are appended to manuals.Accordingly, an index appended to the manual may be used as the indexdata. That is, data of the index may be extracted from the manual and beused as the index data. In addition, the index data may be individuallygenerated to be suitably used in the present system. In this case, indexdata corresponding to the setting of the equipment derived by theinstruction information analysis unit 10C is generated.

The manual database 14B is stored in the auxiliary storage device 14. Inthe present embodiment, the manual database 14B is an example of asecond database in which information related to the manual of theequipment C is recorded.

The operation method derivation unit 10D specifies a page of the manualon which a target operation method is described (a location in which theoperation method of the equipment required for the setting is described)by referring to the index data. That is, in the present embodiment, theoperation method of the equipment C is derived by finding the operationmethod of the equipment C required for performing the derived settingfrom the manual of the equipment C. The operation method derivation unit10D extracts data of the specified page from the body data and outputsthe extracted data as information about the operation method (operationinformation). For example, in a case where a setting “F number: low,exposure correction: positive”) is derived, the operation methodderivation unit 10D outputs the operation information as follows. First,a page on which an operation method of “F number” is described and apage on which an operation method of the exposure correction isdescribed are specified from the index data of the manual of theequipment C used by the imaging person P1. Next, data of the specifiedpages is extracted from the body data of the manual. The extracted dataof the pages is output as the operation information. In the presentembodiment, the operation information is an example of third informationrelated to the information about the operation method.

The operation information output unit 10E outputs (transmits) theoperation information to the first terminal apparatus T1 of the imagingperson P1. In the present embodiment, the instruction information andthe setting information are output together with the operationinformation.

The first terminal apparatus T1 acquires (receives) the operationinformation, the instruction information, and the setting informationoutput (transmitted) from the operation information output unit 10E andoutputs (displays) the operation information, the instructioninformation, and the setting information to the display 105.

FIG. 9 is a diagram illustrating an example of display of the operationinformation, the instruction information, and the setting information onthe display. FIG. 9 illustrates an output example of the operationinformation with respect to the imaging instruction “please performimaging to have a soft look”.

As described above, the setting information “F number: low, exposurecorrection: positive” is derived from the imaging instruction “pleaseperform imaging to have a soft look”. The data of the page of the manualon which the operation method of the F number is described and the dataof the page of the manual on which the operation method of the exposurecorrection is described are output from the setting information as theoperation information. An example in which the data of the page of themanual on which the operation method of the F number is described isdisplayed as the operation information is illustrated in (A) of FIG. 9 .An example in which the data of the page of the manual on which theoperation method of the exposure correction is described is displayed asthe operation information is illustrated in (B) of FIG. 9 .

As illustrated in (A) and (B) of FIG. 9 , a first region R1 to a fourthregion R4 are set on the screen of the display 105 of the first terminalapparatus T1 as a display region of information. The first region R1 isa display region of information “instruction content” and displays theinstruction information. The second region R2 is a display region ofinformation “setting of equipment” and displays the setting information.In a case where a plurality of setting items are included in the settinginformation, each item is displayed with a number. The third region R3is a display region of information “operation method” and displaysinformation about an item to be operated. That is, information about asetting item to be operated is displayed. A display example in a casewhere the setting item to be operated is “F number” is illustrated in(A) of FIG. 9 . An example in a case where the setting item to beoperated is “exposure correction” is illustrated in (B) of FIG. 9 . Thefourth region R4 is a display region of the manual and displays the dataof the page of the manual on which the operation method of the settingitem to be operated is described. A display example of the data of thepage of the manual on which the operation method of the F number isdescribed is illustrated in (A) of FIG. 9 . A display example of thedata of the page of the manual on which the operation method of theexposure correction is described is illustrated in (B) of FIG. 9 . Forexample, the data of the page displayed in the fourth region R4 isenlarged, reduced, and moved by operations such as pinching in, pinchingout, and sliding on the screen. A switching button B1 is displayed inthe fourth region R4. A setting item to be displayed is switched bytouching the switching button B1.

The display form in FIG. 9 is merely an example, and the display of theoperation information and the like can employ various forms.

Action of Information Processing System

Next, a flow of a series of processes (information processing method)performed by the information processing system 1 of the presentembodiment will be described.

As described above, the information processing system 1 of the presentembodiment is configured as a system that receives the instruction withrespect to imaging from the requesting person P2, derives the operationmethod of the equipment C required for performing imaging complying withthe instruction, and presents the operation method to the imaging personP1. Connection between the imaging person P1 and the requesting personP2 is made using a well-known matching service, a social networkingservice (SNS), or the like. As an example, matching is established suchthat the requesting person P2 posts content of a request (a target to beimaged, an imaging location, an imaging date and time, and the like) onan electronic bulletin board using a computer network, and a person whocan contract for the request applies for the posting. In addition, forexample, it is possible to employ a method of establishing matching byextracting and presenting a user who matches the content of the requestof the requesting person P2 from users who have registered availableconditions for imaging (the target to be imaged, the imaging location,and the imaging date and time).

FIG. 10 is a sequence diagram of processing performed by the informationprocessing system.

First, the imaging person P1 inputs the information about the equipmentC (equipment information) used in imaging into the first terminalapparatus T1 (step S1). The manufacturer name and the apparatus typename are input as the equipment information. The input equipmentinformation is transmitted to the information processing apparatus 10(step S2). The information processing apparatus 10 receives theequipment information transmitted from the first terminal apparatus T1and acquires the input of the equipment information (step S3).

Meanwhile, the requesting person P2 of imaging inputs the informationabout the content of the instruction with respect to imaging(instruction information) into the second terminal apparatus T2 (stepS4). The instruction content is input as a sentence expressed in anatural language. The input instruction information is transmitted tothe information processing apparatus 10 (step S5). The informationprocessing apparatus 10 receives the instruction information transmittedfrom the second terminal apparatus T2 and acquires the input of theinstruction information (step S6).

The information processing apparatus 10 analyzes the acquiredinstruction information and derives the setting of the equipmentrequired for performing imaging complying with the instruction (stepS7). In this case, first, the information processing apparatus 10extracts the topic from the sentence indicating the content of theinstruction. Next, the setting of the equipment corresponding to thetopic is derived by referring to the equipment setting database 14A.

After the setting of the equipment is derived, the operation method ofthe equipment C required for performing the derived setting is derived(step S8).

In this case, the information processing apparatus 10 derives theoperation method of the equipment C by referring to the manual database14B. More specifically, the operation method is derived using thefollowing procedure. First, the data of the manual of the equipment Cused by the imaging person P1 is acquired from the manual database 14Bbased on the equipment information. Next, the page of the manual onwhich the target operation method is described is specified by referringto the index data included in the data of the manual. That is, the pageon which the operation method for performing the derived setting isspecified. The data of the specified page is extracted from the bodydata of the manual, and the operation information is derived.

The information processing apparatus 10 outputs (transmits) the derivedoperation information to the first terminal apparatus T1 of the imagingperson P1 (step S9).

The first terminal apparatus T1 acquires (receives) the operationinformation output (transmitted) from the information processingapparatus 10 (step S10) and displays the operation information on thedisplay 105 in a predetermined format (step S11). The imaging person P1checks the display (refer to FIG. 9 ) of the display 105 of the firstterminal apparatus T1 and performs imaging by operating the equipment C.For example, captured images are transmitted to the second terminalapparatus T2 from the first terminal apparatus T1 through theinformation processing apparatus 10.

As described so far, according to the information processing system 1 ofthe present embodiment, an imaging method for performing imagingcomplying with the instruction of the requesting person P2 is presentedto the imaging person P1. Accordingly, even in a case where the imagingperson P1 is not familiar with the imaging equipment, an appropriateimaging instruction can be provided. In addition, in a case ofrequesting another person to perform imaging using the matching serviceor the like, it is possible to perform imaging that reflects theintention of the requesting person P2.

Second Embodiment

FIG. 11 is a diagram illustrating a second embodiment of the informationprocessing system.

The information processing system 1 of the present embodiment isconfigured as a system that enables the requesting person P2 to checkthe images being captured by the imaging person P1 in real time. Thatis, a system that enables a video of a live view to be checked with thesecond terminal apparatus T2 on the requesting person P2 side isconfigured (a system that performs so-called live streaming isconfigured).

As illustrated in FIG. 11 , the equipment (camera) C owned by theimaging person P1 and the first terminal apparatus T1 are communicablyconnected, and images displayed on a display Cd of the equipment C aretransmitted to the first terminal apparatus T1. The images transmittedto the first terminal apparatus T1 are transmitted to the informationprocessing apparatus 10 through the communication network 2. The imagestransmitted to the information processing apparatus 10 are furthertransmitted to the second terminal apparatus T2 of the requesting personP2 through the communication network 2 and are displayed on the display205 of the second terminal apparatus T2.

FIG. 12 is a block diagram of main functions provided by the informationprocessing apparatus.

As illustrated in FIG. 12 , the information processing apparatus 10 ofthe present embodiment further has functions of an image acquisitionunit 10F and an image output unit Other functions are the same as thoseof the information processing apparatus 10 of the first embodiment.Accordingly, the functions of the image acquisition unit 10F and theimage output unit 10G will be described here.

The image acquisition unit 10F acquires the images transmitted from thefirst terminal apparatus T1 of the imaging person P1. As describedabove, the images transmitted from the first terminal apparatus T1 arethe images displayed on the display (including an electronic viewfinder) Cd comprised in the equipment C. In a case where a live view isdisplayed on the display Cd of the equipment C, images of the live vieware transmitted. The images are sequentially transmitted. In the presentembodiment, the images of the live view transmitted from the equipment Cthrough the first terminal apparatus T1 are an example of imagescaptured by the equipment C in time series.

A method of communication between the first terminal apparatus T1 andthe equipment C is not particularly limited. As an example, the imagesare transmitted to the first terminal apparatus T1 from the equipment Cusing short range wireless communication such as Bluetooth (registeredtrademark) or a wireless local area network (LAN). These kinds oftechnology are well-known and thus, will not be described in detail.

The image output unit 10G sequentially outputs (transmits) the imagesacquired by the image acquisition unit 10F to the second terminalapparatus T2 of the requesting person P2. The second terminal apparatusT2 of the requesting person P2 sequentially receives the images outputfrom the information processing apparatus 10 and displays the images onthe display 205.

FIG. 13 is a diagram illustrating an example of display on the displayof the second terminal apparatus. FIG. 13 illustrates an example of acase where the live view is displayed on the display Cd in the equipmentC of the imaging person.

As illustrated in FIG. 13 , the images displayed on the display Cd ofthe equipment C of the imaging person are also displayed on the display205 of the second terminal apparatus T2 of the requesting person. In acase where the live view is displayed on the display Cd of the equipmentC of the imaging person, the images of the live view are also displayedon the display 205 of the second terminal apparatus T2 of the requestingperson. In a case where setting information (the shutter speed, the Fnumber, the exposure correction amount, the ISO sensitivity, and thelike) and the like of the equipment are displayed in a superimposedmanner on the images of the live view in the equipment C of the imagingperson, the information is also displayed. By displaying theseinformation together, the requesting person can check with which settingthe imaging person is performing imaging.

According to the information processing system 1 of the presentembodiment, the requesting person P2 can check the images being capturedby the imaging person P1 in real time. Accordingly, the requestingperson P2 can provide a more detailed imaging instruction. Accordingly,it is possible to perform imaging that more reflects the intention ofthe requesting person P2.

While it is configured to transmit information about the screen of theequipment C of the imaging person P1 in the present embodiment, it canalso be configured to transmit only the captured images. In addition, intransmission, sizes of the images may be changed. For example, theimages may be reduced from the sizes of the images displayed on thedisplay Cd of the equipment C and transmitted. Furthermore, the imagesmay be changed in frame rate and transmitted.

Third Embodiment

In the information processing system 1 of the present embodiment, theimages captured by the imaging person P1 are transmitted to the secondterminal apparatus T2 of the requesting person P2. In addition,information related to the setting of the equipment C in capturing theimages is transmitted to the information processing apparatus 10. Basedon the acquired information, the information processing apparatus 10derives the setting of the equipment required for performing imagingcomplying with the instruction from the requesting person P2.

FIG. 14 is a block diagram of main functions provided by the informationprocessing apparatus.

In the same manner as the information processing apparatus 10 of thesecond embodiment, the information processing apparatus 10 of thepresent embodiment has the functions of the image acquisition unit 10Fand the image output unit 10G.

The image acquisition unit 10F acquires the images transmitted from thefirst terminal apparatus T1 of the imaging person P1. The imagestransmitted from the first terminal apparatus T1 include an actuallycaptured image in addition to the images of the live view. That is, animage captured by a release operation (captured image) is included.Information (so-called metadata) related to the setting in capturing theimage is added to the captured image. As an example, exchangeable imagefile format (Exif) data is added to the image. Thus, the informationrelated to the setting in capturing the image can be acquired byreferring to the information (metadata) added to the image. The Exifdata includes information about a resolution of the entire image, aresolution per unit in horizontal and vertical directions, the shutterspeed, a speed, the F number, the ISO sensitivity, a photometry mode,whether or not a flash is used, a step value of the exposure correction,a focal length, and a color space, and the like.

The image output unit 10G outputs (transmits) the images acquired by theimage acquisition unit 10F to the second terminal apparatus T2 of therequesting person P2. Accordingly, the captured image is output to thesecond terminal apparatus T2 of the requesting person P2 in addition tothe images of the live view. The second terminal apparatus T2 of therequesting person P2 receives the images output from the informationprocessing apparatus 10 and displays the images on the display 205.Accordingly, the actually captured image (captured image) is displayedon the display 205 in addition to the images of the live view. Therequesting person P2 checks the actually captured image (captured image)and provides the imaging instruction.

The captured image acquired by the image acquisition unit 10F is furtherprovided to the instruction information analysis unit 10C. Theinstruction information analysis unit 10C derives the setting of theequipment required for performing imaging complying with the instructionbased on the instruction information and on the metadata of the capturedimage.

FIG. 15 is a main block diagram of functions of the instructioninformation analysis unit.

As illustrated in FIG. 15 , the instruction information analysis unit10C of the present embodiment further includes a metadata analysis unit10C3.

The metadata analysis unit 10C3 analyzes the metadata of the capturedimage and acquires the information related to the setting in capturingthe captured image. The acquired information is provided to theequipment setting derivation unit 10C2.

The equipment setting derivation unit 10C2 derives the setting of theequipment corresponding to the topic extracted by the topic extractionunit 10C1. In this case, the equipment setting derivation unit 10C2derives the setting of the equipment corresponding to the topic byreferring to the information acquired by the metadata analysis unit 10C3(the information related to the setting in capturing the capturedimage). As in the first embodiment, the equipment setting derivationunit 10C2 derives the setting of the equipment corresponding to thetopic by referring to the equipment setting database 14A. In theequipment setting database 14A, a plurality of terms related to imagingare recorded, and the setting information of the equipment is recordedin association with each recorded term. In addition, information about apreferable setting range is included in the setting information of theequipment. For example, information “F number: low (F8 to F11), exposurecorrection: positive (+1.0 to +1.5)” is recorded as the settinginformation of the equipment with respect to the term “to have a softlook”.

The equipment setting derivation unit 10C2 acquires the settinginformation of the equipment corresponding to the topic by referring tothe equipment setting database 14A with respect to the topic extractedby the topic extraction unit 10C1. The setting of the equipmentcorresponding to the topic is derived by referring to the informationacquired by the metadata analysis unit 10C3 (the information related tothe setting in capturing the captured image). For example, in a casewhere the setting of the F number is F5.6 and the exposure correction isnot performed in capturing the captured image with respect to the term“to have a soft look”, setting information “F number: low, exposurecorrection: positive” is derived. Meanwhile, in a case where the settingof the F number is F8 and the exposure correction is not performed incapturing the captured image, setting information “exposure correction:positive” is derived.

The operation method derivation unit 10D derives the operation method ofthe equipment C based on the setting information derived by theinstruction information analysis unit 10C.

According to the information processing system of the presentembodiment, it is possible to provide the imaging instruction based onthe image captured by the imaging person P1. In addition, the setting ofthe equipment can be derived based on a result of previously performedimaging (the setting of the equipment). Accordingly, it is possible tocapture an image that reflects the intention of the requesting person.

As in the information processing system of the present embodiment, in acase of deriving the setting of the equipment based on the result ofpreviously performed imaging, a situation in which a preferable settingcannot be derived may occur. For example, in a case where previouslyperformed imaging is performed with a preferable setting range, thesetting cannot be further suggested. In this case, it may be configuredto transmit a message prompting the requesting person P2 to change theinstruction content or a message indicating that the setting cannot beperformed.

Modification Example

While it is configured to derive the setting for performing imagingcomplying with the instruction based on the information related to thesetting of the equipment in capturing the captured image in the aboveembodiment, it may be configured to derive the setting for performingimaging complying with the instruction further based on the capturedimage or based on only the captured image. Specifically, the setting forperforming imaging complying with the instruction is derived byanalyzing the captured image. For example, the setting for performingimaging complying with the instruction is derived by analyzing thecaptured image to obtain brightness, sharpness, and the like of theimage.

Other Embodiments and Modification Examples

System Configuration

While an example in which the first terminal apparatus T1 is configuredas a computer such as a smartphone having a communication function hasbeen described in the embodiments, an apparatus constituting the firstterminal apparatus T1 is not limited thereto. For example, in a casewhere the equipment (imaging equipment) used by the imaging person P1for imaging has a communication function and a function as a computer (aprocessor, a memory, and the like), the imaging equipment can be used asthe first terminal apparatus T1. In this case, direct communication isperformed between the information processing apparatus and the equipmentC such as a camera. In addition, the equipment information is directlytransmitted to the information processing apparatus 10 from theequipment C such as a camera, and the operation information and the likeare directly transmitted to the equipment C such as a camera from theinformation processing apparatus 10. In addition, the transmittedoperation information and the like are directly displayed on the displaycomprised in the equipment C such as a camera.

In addition, the second terminal apparatus T2 can also be configured asa personal computer or the like in addition to a mobile computer such asa smartphone.

In addition, while it is configured to provide the informationprocessing apparatus 10 separately from the first terminal apparatus T1and from the second terminal apparatus T2 in the embodiments, the firstterminal apparatus T1 or the second terminal apparatus T2 may have thefunctions of the information processing apparatus 10. That is, the firstterminal apparatus T1 or the second terminal apparatus T2 may beconfigured to perform various types of processing performed by theinformation processing apparatus 10.

Data Related to Manual

While it is configured to record data related to the manual in themanual database 14B in advance in the embodiments, a method of acquiringthe data related to the manual is not limited thereto. For example, itmay be configured to cause the imaging person P1 to transmit the datarelated to the manual to the information processing apparatus 10 throughthe first terminal apparatus T1. In this case, it may be configured torecord the data related to the manual transmitted from the imagingperson P1 in the manual database 14B. Accordingly, data related tomanuals of a plurality of pieces of equipment can be collected. Inaddition, it may be configured to request the imaging person P1 toprovide the data related to the manual only in a case where the datarelated to the manual of the equipment used by the imaging person P1 isnot recorded in the manual database 14B.

Derivation of Operation Method

While the operation method of the equipment is derived by extracting thedata of the corresponding page of the manual data in the embodiments, amethod of deriving the operation method of the equipment is not limitedthereto. For example, it may be configured to derive the operationmethod by extracting only a region in which the operation method isdescribed on the corresponding page instead of the data of the entirepage.

In addition, for example, it may be configured to search for a web pageon which the target operation method is posted on the internet and tooutput the corresponding web page as the operation information. Forexample, the web page on which the target operation method is posted issearched by targeting a website of the manufacturer of the equipmentused by the imaging person P1, and the corresponding web page is outputas the operation information. In this case, for example, the web page onwhich the target operation method is posted may be searched using awell-known search engine.

In addition, while it is configured to search for the corresponding pageusing the index data in the embodiments, it may be configured to searchfor the corresponding page by analyzing the body data.

In addition, the data related to the manual can also be configured asvideo data. That is, the operation method corresponding to each term isrecorded as a video.

Output of Operation Information and Like

While it is configured to output the instruction information and thesetting information to the first terminal apparatus T1 of the imagingperson P1 together with the operation information in the embodiments,the operation information may be the only information output to thefirst terminal apparatus T1 of the imaging person P1. That is, it may beconfigured to notify the imaging person P1 of the instructioninformation and of the setting information by other means (for example,a telephone or an electronic mail). In addition, for example, it may beconfigured to provide a so-called chat function in the informationprocessing apparatus 10 so that messages can be transmitted and receivedbetween the requesting person P2 and the imaging person P1.

Derivation of Setting Information

For example, it may be configured to directly derive the setting of theequipment (setting information) required for performing imagingcomplying with the instruction from the instruction information using atrained model or the like.

In addition, in a case of setting a plurality of items, an order of theplurality of items, that is, an order of setting, can also be defined.In this case, operation methods are set to be displayed in the definedorder.

Equipment Used for Imaging

As described above, the equipment used for imaging includes an apparatushaving a camera function such as a smartphone with a camera in additionto a so-called camera. In addition, the camera is not limited to adigital camera, and a video camera, a television camera, a movie camera,and the like are also included. In addition, a so-called film camera isalso included.

In addition, the imaging instruction is not limited to an imaginginstruction for a still image, and an imaging instruction for a video isalso included.

Requesting Person and Imaging Person

The requesting person and the imaging person may be identical. In thiscase, a specific operation method in a case of performing specificimaging can be known for the used equipment.

Hardware Configuration of Information Processing Apparatus

Each function of the information processing apparatus can be configuredusing various processors. The various processors include a centralprocessing unit (CPU) that is a general-purpose processor functioning asvarious processing units by executing a program, a programmable logicdevice (PLD) such as a field programmable gate array (FPGA) that is aprocessor having a circuit configuration changeable after manufacture, adedicated electric circuit such as an application specific integratedcircuit (ASIC) that is a processor having a circuit configurationdedicatedly designed to execute specific processing, and the like. Oneprocessing unit constituting the information processing apparatus may becomposed of one of the various processors or of two or more processorsof the same type or different types. For example, one processing unitmay be composed of a plurality of FPGAs or of a combination of a CPU andan FPGA. In addition, a plurality of processing units may be composed ofone processor. A first example of a plurality of processing unitscomposed of one processor is, as represented by computers such as aclient and a server, a form of one processor composed of a combinationof one or more CPUs and software, in which the processor functions as aplurality of processing units. A second example is, as represented by asystem on chip (SoC) and the like, a form of using a processor thatimplements functions of the entire system including a plurality ofprocessing units in one integrated circuit (IC) chip. Various processingunits are configured using one or more of the various processors as ahardware structure. Furthermore, the hardware structure of those variousprocessors is more specifically an electric circuit (circuitry) in whichcircuit elements such as semiconductor elements are combined.

EXPLANATION OF REFERENCES

-   -   1: Information processing system    -   2: communication network    -   2 a: base station    -   10: information processing apparatus    -   10A: equipment information acquisition unit    -   10B: instruction information acquisition unit    -   10C: instruction information analysis unit    -   10C1: topic extraction unit    -   10C2: equipment setting derivation unit    -   10C3: metadata analysis unit    -   10D: operation method derivation unit    -   10E: operation information output unit    -   10F: image acquisition unit    -   10G: image output unit    -   11: CPU    -   12: ROM    -   13: RAM    -   14: auxiliary storage device    -   14A: equipment setting database    -   14B: manual database    -   15: display    -   16: network OF    -   17: keyboard    -   18: mouse    -   19: optical drive    -   101: CPU    -   102: ROM    -   103: RAM    -   104: flash memory    -   105: display    -   106: touch panel    -   107: GPS reception unit    -   108: camera unit    -   109: microphone unit    -   110: speaker unit    -   111: communication unit    -   111A: antenna    -   112: short range wireless communication unit    -   112A: antenna    -   113: sensor unit    -   114: media drive    -   115: memory card    -   201: CPU    -   202: ROM    -   203: RAM    -   204: flash memory    -   205: display    -   206: touch panel    -   207: GPS reception unit    -   208: camera unit    -   209: microphone unit    -   210: speaker unit    -   211: communication unit    -   211A: antenna    -   212: short range wireless communication unit    -   212A: antenna    -   213: sensor unit    -   214: media drive    -   215: memory card    -   B1: switching button    -   C: equipment    -   Cd: display of equipment    -   P1: imaging person    -   P2: requesting person    -   R1: first region on display screen of first terminal apparatus    -   R2: second region on display screen of first terminal apparatus    -   R3: third region on display screen of first terminal apparatus    -   R4: fourth region on display screen of first terminal apparatus    -   T1: first terminal apparatus    -   T2: second terminal apparatus    -   S1 to S11: procedure of processing performed by information        processing system

What is claimed is:
 1. An information processing apparatus comprising: aprocessor, wherein the processor is configured to: acquire input offirst information related to information about equipment used forimaging; acquire input of second information related to informationabout content of an instruction with respect to imaging; derive asetting of the equipment required for performing imaging complying withthe instruction and an operation method of the equipment required forthe setting based on the first information and on the secondinformation; and output third information related to information aboutthe operation method.
 2. The information processing apparatus accordingto claim 1, wherein the processor is further configured to output thesecond information.
 3. The information processing apparatus according toclaim 1, wherein the second information is composed of text information,and the processor is configured to: extract a topic related to imagingfrom the text information; and derive the setting corresponding to thetopic.
 4. The information processing apparatus according to claim 3,wherein the processor is configured to derive the setting correspondingto the topic by referring to a first database in which informationrelated to the setting is recorded.
 5. The information processingapparatus according to claim 4, wherein the processor is configured toderive the setting corresponding to the topic by referring to the firstdatabase in which the topic and the information related to the settingare recorded in association with each other.
 6. The informationprocessing apparatus according to claim 1, wherein the processor isconfigured to: acquire information related to a manual corresponding tothe equipment from a second database in which information related to amanual of the equipment is recorded; and derive the operation methodbased on the information related to the manual.
 7. The informationprocessing apparatus according to claim 6, wherein the first informationincludes the information related to the manual of the equipment, and theprocessor is configured to acquire the input of the first informationand record the information related to the manual of the equipmentincluded in the first information in the second database.
 8. Theinformation processing apparatus according to claim 6, wherein theprocessor is configured to extract, from the manual of the equipment, alocation in which the operation method of the equipment required for thesetting is described.
 9. The information processing apparatus accordingto claim 1, wherein the processor is configured to: acquire the input ofthe first information from a first terminal; acquire the input of thesecond information from a second terminal; and output the thirdinformation and the second information to the first terminal.
 10. Theinformation processing apparatus according to claim 9, wherein theprocessor is configured to receive images captured by the equipment intime series and transmit the images to the second terminal.
 11. Theinformation processing apparatus according to claim 1, wherein theprocessor is configured to: receive information related to a setting ofthe equipment in capturing an image; and derive the setting of theequipment required for performing imaging complying with the instructionand the operation method of the equipment required for the setting basedon the first information, the second information, and the informationrelated to the setting of the equipment in capturing the image.
 12. Aninformation processing system comprising: a first terminal owned by afirst user contracted to perform imaging; a second terminal owned by asecond user who requests imaging; and the information processingapparatus according to claim 1, wherein the information processingapparatus acquires the input of the first information from the firstterminal, acquires the input of the second information from the secondterminal, and outputs the third information to the first terminal. 13.An information processing method comprising: acquiring input of firstinformation related to information about equipment used for imaging;acquiring input of second information related to information aboutcontent of an instruction with respect to imaging; deriving a setting ofthe equipment required for performing imaging complying with theinstruction and an operation method of the equipment required for thesetting based on the first information and on the second information;and outputting third information related to information about theoperation method.
 14. A non-transitory, computer readable tangiblerecording medium which records thereon a program for causing, when readby a computer, the computer to implement: a function of acquiring inputof first information related to information about equipment used forimaging; a function of acquiring input of second information related toinformation about content of an instruction with respect to imaging; afunction of deriving a setting of the equipment required for performingimaging complying with the instruction and an operation method of theequipment required for the setting based on the first information and onthe second information; and a function of outputting third informationrelated to information about the operation method.